Social familiarity and reinforcement value: a behavioral-economic analysis of demand for social interaction with cagemate and non-cagemate female rats.

Rats were studied in social reinforcement procedures in which lever presses opened a door separating two adjacent spaces, permitting access to social interaction with a partner rat. The number of lever presses required for social interaction was systematically increased across blocks of sessions according to fixed-ratio schedules, generating demand functions at three different social reinforcement durations: 10 s, 30 s, and 60 s. The social partner rats were cagemates in one phase, and non-cagemates in a second phase. The rate at which social interactions were produced declined with the fixed-ratio price, and was well described by an exponential model that has been successfully employed with a range of social and non-social reinforcers. None of the main parameters of the model varied systematically with social interaction duration or with the social familiarity of the partner rat. On the whole, the results provide further evidence of the reinforcing value of social interaction, and its functional parallels with non-social reinforcers.

Failure to Find Altruistic Food Sharing in Rats.

Prior research has found that one rat will release a second rat from a restraint in the presence of food, thereby allowing that second rat access to food. Such behavior, clearly beneficial to the second rat and costly to the first, has been interpreted as altruistic. Because clear demonstrations of altruism in rats are rare, such findings deserve a careful look. The present study aimed to replicate this finding, but with more systematic methods to examine whether, and under what conditions, a rat might share food with its cagemate partner. Rats were given repeated choices between high-valued food (sucrose pellets) and 30-s social access to a familiar rat, with the (a) food size (number of food pellets per response), and (b) food motivation (extra-session access to food) varied across conditions. Rats responded consistently for both food and social interaction, but at different levels and with different sensitivity to the food-access manipulations. Food production and consumption was high when food motivation was also high (food restriction) but substantially lower when food motivation was low (unlimited food access). Social release occurred at moderate levels, unaffected by the food-based manipulations. When food was abundant and food motivation low, the rats chose food and social options about equally often, but sharing (food left unconsumed prior to social release) occurred at low levels across sessions and conditions. Even under conditions of low food motivation, sharing occurred on only 1% of the sharing opportunities. The results are therefore inconsistent with claims in the literature that rats are altruistically motivated to share food with other rats.

Social preference in rats.

Rats were given repeated choices between social and nonsocial outcomes, and between familiar and unfamiliar social outcomes. Lever presses on either of 2 levers in the middle chamber of a 3-chamber apparatus opened a door adjacent to the lever, permitting 45-s access to social interaction with the rat in the chosen side chamber. In Experiment 1, rats preferred (a) social over nonsocial options, choosing their cagemate rat over an empty chamber, and (b) an unfamiliar over a familiar rat, choosing a non-cagemate over their cagemate. These findings were replicated in Experiment 2 with 2 different non-cagemate rats. Rats preferred both non-cagemate rats to a similar degree when pitted against their cagemate, but were indifferent when the 2 non-cagemates were pitted against each other. Similar preference for social over nonsocial and non-cagemate over cagemate was seen in Experiment 3, with new non-cagemate rats introduced after every third session. Response rates (for both cagemate and non-cagemate rats) were elevated under conditions of nonsocial (isolated) housing compared to conditions of social (paired) housing, demonstrating a social deprivation effect. Together, the experiments contribute to an experimental analysis of social preference within a social reinforcement framework, drawing on methods with proven efficacy in the analysis of reinforcement more generally.

To free, or not to free: Social reinforcement effects in the social release paradigm with rats.

The present research measured social reinforcement in rats, using a social-release procedure in which lever presses permitted 10-s access to a familiar social partner. The work requirements for reinforcement increased systematically according to progressive-ratio (PR) schedules. Social and food reinforcement value were compared across blocks of sessions (Experiment 1) and concurrently within the same sessions (Experiment 2). To assess motivational effects, response and reinforcer rates for both reinforcer types were studied under food restriction, social restriction, and combined food and social restriction. Responding was maintained by both reinforcers, albeit at substantially higher levels for food than for social access. Responding for social access decreased to low levels under extinction conditions, demonstrating functional control by the social-reinforcement contingency. Sensitivity to social restriction was seen in some conditions in Experiment 2, in which social reinforcers were earned earlier in the session (at lower food prices) under social restriction than under the other deprivation conditions. Altogether, results are consistent with a social reinforcement conceptualization, and demonstrate an important role for social contact in social release behavior. The study demonstrates a promising set of methods for analyzing and quantifying social reinforcement.

Token reinforcement: Translational research and application.

The present paper provides an integrative review of research on token reinforcement systems, organized in relation to basic behavioral functions and economic variables. This type of functional taxonomy provides a useful way to organize the literature, bringing order to a wide range of findings across species and settings, and revealing gaps in the research and areas especially ripe for analysis and application. Unlike standard translational research, based on a unidirectional model in which the analysis moves from laboratory to the applied realm, work in the area of token systems is best served by a bidirectional interplay between laboratory and applied research, where applied questions inspire research on basic mechanisms. When based on and contributing to an analysis, applied research on token economies can be on the leading edge of theoretical advances, helping set the scientific research agenda.

Opioidergic and dopaminergic modulation of cost/benefit decision-making in Long Evans Rats.

Eating disorders are associated with impaired decision-making and dysfunctional reward-related neurochemistry. The present study examined the potential contributions of dopamine and opioid signaling to these processes using two different decision-making tasks. In one task, Long Evans Rats chose between working for a preferred food (high-carbohydrate banana-flavored sucrose pellets) by lever pressing on a progressive-ratio schedule of reinforcement vs. obtaining less preferred laboratory chow that was concurrently available. In a second (effort-free) task, rats chose between the same two reinforcers when they were both available freely. Rats were trained in these tasks before receiving haloperidol (0.00, 0.05, 0.10mg/kg, intraperitoneally (i.p.)) or naloxone (0.0, 1.5, 3.0mg/kg, i.p.). In the first task, haloperidol decreased breakpoint, lever presses, number of reinforcers earned, and increased chow intake, whereas naloxone decreased breakpoint and number of reinforcers earned but had no effect on chow consumption. In the effort-free task, haloperidol reduced intakes of both foods without affecting preference, whereas naloxone selectively reduced the consumption of banana-pellets. The present findings support converging evidence suggesting that DA signaling affects processes more closely related to appetitive motivation, leaving other components of motivation unchanged. By contrast, opioid signaling appears to mediate aspects of hedonic feeding by selectively altering intakes of highly palatable foods. For preferred foods, both appetitive and consummatory aspects of food intake were altered by opioid receptor antagonism. Our findings argue against a general suppression of appetite by either compound, as appetite manipulations have been shown to unselectively alter intakes of both types of food regardless of the task employed.

Substitution effects in a generalized token economy with pigeons.

Pigeons made repeated choices between earning and exchanging reinforcer-specific tokens (green tokens exchangeable for food, red tokens exchangeable for water) and reinforcer-general tokens (white tokens exchangeable for food or water) in a closed token economy. Food and green food tokens could be earned on one panel; water and red water tokens could be earned on a second panel; white generalized tokens could be earned on either panel. Responses on one key produced tokens according to a fixed-ratio schedule, whereas responses on a second key produced exchange periods, during which all previously earned tokens could be exchanged for the appropriate commodity. Most conditions were conducted in a closed economy, and pigeons distributed their token allocation in ways that permitted food and water consumption. When the price of all tokens was equal and low, most pigeons preferred the generalized tokens. When token-production prices were manipulated, pigeons reduced production of the tokens that increased in price while increasing production of the generalized tokens that remained at a fixed price. The latter is consistent with a substitution effect: Generalized tokens increased and were exchanged for the more expensive reinforcer. When food and water were made freely available outside the session, token production and exchange was sharply reduced but was not eliminated, even in conditions when it no longer produced tokens. The results join with other recent data in showing sustained generalized functions of token reinforcers, and demonstrate the utility of token-economic methods for assessing demand for and substitution among multiple commodities in a laboratory context.

Functional analysis of mutual behavior in laboratory rats (Rattus norvegicus).

Three pairs of rats were trained to synchronize their lever pressing according to a mutual reinforcement contingency, in which alternating lever presses that fell within a 500-ms window were reinforced with food. In Experiment 1, rats worked in adjacent chambers separated by a transparent barrier, and the effects of the mutual reinforcement contingency were compared with those under yoked-control conditions that provided the same rate of food reinforcement but without the temporal coordination response requirement. In Experiment 2, coordinated behavior was compared with and without a barrier, and across different barrier types: transparent, opaque, wire mesh. In Experiment 3, the effects of social familiarity were assessed by switching partners, enabling a comparison of coordinated behavior with familiar and unfamiliar partners. The overall pattern of results shows that the coordinated behavior of 2 rats was (a) maintained by mutual reinforcement contingencies, (b) unrelated to the type or presence of a barrier separating the rats, and (c) sufficiently flexible to adjust to the presence and behavior of an unfamiliar partner. Taken as a whole, the study illustrates a promising approach to conceptualizing and analyzing behavioral mechanisms of mutual behavior, an important component of an integrated study of social behavior.

Pigeons' demand and preference for specific and generalized conditioned reinforcers in a token economy.

Pigeons' demand and preference for specific and generalized tokens was examined in a token economy. Pigeons could produce and exchange different colored tokens for food, for water, or for food or water. Token production was measured across three phases, which examined: (1) across-session price increases (typical demand curve method); (2) within-session price increases (progressive-ratio, PR, schedule); and (3) concurrent pairwise choices between the token types. Exponential demand curves were fitted to the response data and accounted for over 90% total variance. Demand curve parameter values, Pmax , Omax and α showed that demand was ordered in the following way: food tokens, generalized tokens, water tokens, both in Phase 1 and in Phase 3. This suggests that the preferences were predictable on the basis of elasticity and response output from the demand analysis. Pmax and Omax values failed to consistently predict breakpoints and peak response rates in the PR schedules in Phase 2, however, suggesting limits on a unitary conception of reinforcer efficacy. The patterns of generalized token production and exchange in Phase 3 suggest that the generalized tokens served as substitutes for the specific food and water tokens. Taken together, the present findings demonstrate the utility of behavioral economic concepts in the analysis of generalized reinforcement.

The several roles of stimuli in token reinforcement.

Three experiments were conducted with pigeons to identify the stimulus functions of tokens in second-order token-reinforcement schedules. All experiments employed two-component multiple schedules with a token-reinforcement schedule in one component and a schedule with equivalent response requirements and/or reinforcer density in the other. In Experiment 1, response rates were lower under a token-reinforcement schedule than under a tandem schedule with the same response requirements, suggesting a discriminative role for the tokens. In Experiment 2, response rates varied systematically with signaling functions of the tokens in a series of conditions designed to explore other aspects of the temporal-correlative relations between tokens and food. In Experiment 3, response rates were reduced but not eliminated by presenting tokens independent of responding, yoked to their temporal occurrence in a preceding token component, suggesting both a reinforcing function and eliciting/evocative functions based on stimulus-food relations. Only when tokens were removed entirely was responding eliminated. On the whole, the results suggest that tokens, as stimuli temporally correlated with food, may serve multiple stimulus functions in token-reinforcement procedures--reinforcing, discriminative, or eliciting--depending on the precise arrangement of the contingencies in which they are embedded.

Generalized conditioned reinforcement with pigeons in a token economy.

Six pigeons were studied in a token economy in which tokens could be produced and exchanged for food on one side of an experimental chamber and for water on the opposite side of the chamber. Responses on one key produced tokens according to a token-production fixed ratio (FR) schedule. Responses on a second key produced an exchange period during which tokens were exchanged for water or food. In Experiment 1a, food tokens could be earned and exchanged under restricted food budgets, and water tokens could be earned and exchanged under water restricted budgets. In Experiment 1b, a third (generalized) token type could be earned and exchanged for either food or water under water restricted budgets. Across Experiments 1a and 1b, the number of tokens accumulated prior to exchange increased as the exchange-production schedule was increased. In Experiment 1b, pigeons produced more generalized than specific tokens, suggesting enhanced reinforcing efficacy of generalized tokens. In Experiment 2, the FR token-production price was manipulated under water restriction and then under food restriction. Production of each token type generally declined as a function of its own price and increased as a function of the price of the alternate type, demonstrating own-price and cross-price elasticity. Production of food and water tokens often changed together, indicating complementarity. Production of specific and generalized tokens changed in opposite directions, indicating substitutability. This is the first demonstration of sustained generalized functions of tokens in nonhumans, and illustrates a promising method for exploring economic contingencies in a controlled environment.

Effects of predictability and competition on group and individual choice in a free-ranging foraging environment.

The present study examined the social foraging of rats in an open arena. The relative quantity of food varied across two food sources, or "patches." Five food quantity ratios (1:1, 1:2, 1:8, 8:1, 2:1) were presented in a series of 30-min sessions. Ratios varied randomly across 6-min components within sessions (Phase 1), or in a consistent order across sessions (Phase 2). Group and individual preferences were well described by the ideal free distribution and the generalized matching law, respectively, with evidence of undermatching at both group and individual levels. Sensitivity of individual and collective behavior to the relative quantities of food was higher in Phase 2 than in Phase 1. Competitiveness rankings, assessed before and after experimental sessions by delivering food in rapid succession from a single feeder, was positively related to sensitivity values in Phase 1, but less consistently so in Phase 2. This study illustrates a promising experimental method for investigating foraging in a social context.

Varying the costs of sunk costs: optimal and non-optimal choices in a sunk-cost task with humans.

Twelve adult human subjects were exposed to a sunk-cost procedure with two options: a mixed-ratio schedule of points later exchangeable for money, and an escape schedule that cancelled the current trial and initiated a new one. The mixed ratio included four values, arranged probabilistically in such a way that the expected ratios favored either persistence or escape. These probabilities were varied systematically on a within-subject basis across conditions. Absolute ratio size was thus varied across four groups of three subjects each, yielding unique combinations of expected ratios from escaping and persisting. When the differences between escaping and persisting differed the least, subjects tended to persist, committing the sunk-cost error. When the differences between persisting and escaping differed by a larger margin, choice patterns tended toward optimal-escaping or persisting as a function of the contingencies. These findings demonstrate that sunk-cost decision-making errors in humans are sensitive to their relative costs and benefits, and illustrate a promising set of methods for bringing such behavior under experimental control in the laboratory.

Optimal and nonoptimal choice in a laboratory-based sunk cost task with humans: a cross-species replication.

The current four experiments examined the sunk cost effect-nonoptimal persistence following investment-in a laboratory-based decision-making task with adult humans. Subjects made repeated decisions about whether to persist in a course of action-a fixed-ratio schedule whose response requirements varied unpredictably from one trial to the next-or to abandon it and escape in favor of a new trial with a potentially smaller fixed ratio schedule. Satisfying the ratio requirement produced a brief video clip from a preferred television program. In Experiment 1, sunk-cost errors were less likely in subjects who had previously experienced markedly differential reinforcement for escape. In Experiment 2, stimulus changes correlated with changes in mean response requirement, and these changes reduced sunk-cost errors in a small number of subjects. In Experiment 3, sunk-cost errors occurred more frequently as the ratio of the mean response requirements for persistence and escape approached 1.0. The importance of this variable was further supported by the results of Experiment 4, in which features other than this ratio did not markedly alter performance. These four experiments identified some key determinants of whether humans commit the sunk-cost error and confirmed the utility of video clips as reinforcers in experimental research with humans.

Response to Ahrendt, Houlihan, and Buchanan.

This paper reports some puzzling results from a token economy in an inpatient behavioral treatment facility. A seemingly insignificant change from poker chip tokens to sticker tokens produced substantial increases in problem behavior-as measured by frequency of time-outs for problem behavior. The results are puzzling because it is generally assumed that qualitative aspects of the tokens-such as whether or not they are handled-should not matter. What should matter is simply the correlation between tokens and other reinforcers for which they are exchanged. Indeed, the successful use of check marks, stickers, and stars in scores of token systems over the years shows pretty clearly that stickers and other nonhandled tokens are up to the job.

Risky choice in pigeons: preference for amount variability using a token-reinforcement system.

Pigeons were given repeated choices between variable and fixed numbers of token reinforcers (stimulus lamps arrayed above the response keys), with each earned token exchangeable for food. The number of tokens provided by the fixed-amount option remained constant within blocks of sessions, but varied parametrically across phases, assuming values of 2, 4, 6, or 8 tokens per choice. The number of tokens provided by the variable-amount option varied between 0 and 12 tokens per choice, arranged according to an exponential or rectangular distribution. In general, the pigeons strongly preferred the variable option when the fixed option provided equal or greater numbers of tokens than the variable amount. Preference for the variable amount decreased only when the alternatives provided widely disparate amounts favoring the fixed amount. When tokens were removed from the experimental context, preference for the variable option was reduced or eliminated, suggesting that the token presentation played a key role in maintaining risk-prone choice patterns. Choice latencies varied inversely with preferences, suggesting that local analyses may provide useful ancillary measures of reinforcer value. Overall, the results indicate that systematic risk sensitivity can be attained with respect to reinforcer amount, and that tokens may be critical in the development of such preferences.

Saving the best for last? A cross-species analysis of choices between reinforcer sequences.

Two experiments were conducted to compare choices between sequences of reinforcers in pigeon (Experiment 1) and human (Experiment 2) subjects, using functionally analogous procedures. The subjects made pairwise choices among 3 sequence types, all of which provided the same overall reinforcerment rate, but differed in their temporal patterning. Token reinforcement schedules were used in both experiments and the type of exchange schedule varied across blocks of sessions. Some conditions permitted immediate exchange of tokens for consumable reinforcers (food for pigeons, video access for humans); in other conditions, tokens accumulated and were exchanged for consumable reinforcers only at the end of the sequence. Choice patterns in the immediate-exchange conditions were generally similar across species, with both pigeons and humans preferring sequences with the shortest delay to the initial reinforcer in the series. The results are broadly consistent with models of temporal discounting expanded to include the impact of sequences of delayed reinforcers acting in parallel from the time of the choice. Preferences were less consistent with discounting models in the delayed exchange conditions. Questionnaire data gathered at the end of the experiment were consistent with prior results of questionnaire studies, but showed no straightforward relation to the observed choice patterns, urging caution in the extrapolation of results from one decision-making domain to the other.

The sunk cost effect with pigeons: some determinants of decisions about persistence.

The sunk cost effect occurs when an individual persists following an initial investment, even when persisting is costly in the long run. The current study used a laboratory model of the sunk cost effect. Two response alternatives were available: Pigeons could persist by responding on a schedule key with mixed ratio requirements, or escape by responding on a second key. In Experiment 1, mean response requirements for persistence and escape were varied across conditions. Pigeons persisted (committing the sunk cost error) when persisting increased the mean response requirement only slightly but not when persisting was sufficiently nonoptimal. Experiment 2 explored more systematically combinations of ratios and probabilities assigned to the schedule key. Persistence varied with the ratio of the mean global response requirements for persistence and escape. In Experiment 3, transitions between ratios were signaled. This reduced nonoptimal persistence, and produced some instances of a reverse sunk cost error--escaping when persistence was optimal. In Experiment 4, it was optimal to escape after the second-smallest ratio ever presented. Pigeons escaped at approximately the optimal juncture, especially in conditions with added signals. Overall, this series of experiments suggests that the sunk cost error may arise in part because persistence is the default behavioral strategy in situations where the contingencies for escape and persistence are insufficiently disparate and/or it is relatively difficult to discriminate when to escape. The study also demonstrates the utility of animal models of complex decision making situations.